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CHAPTER I 



INTRODUCTION 

The statistical model developed and stated in NAV^EPS 
OD 29304 "Guide Manual For Reliability Measurement program" 
was developed for the Department of the Navy, Special 
Projects Office. It contains very versatile procedures for 
obtaining both system reliability point estimates and system 
reliability lower confidence limits using a variety of test 
data on component parts, subassemblies, assemblies, and 
subsystems. 

This document makes the following assumptions on the 
components of the series system: 

(1) Constant failure rate 

(2) Additivity of stress effects 

(3) Independence of part failure 

(4) Failure rate constancy 

The purpose of this thesis is to check the accuracy of 
this statistical model without the assumption of a constant 
failure rate. The model will be checked for a system com- 
posed of four components in series, using various sample 
sizes, mission times, and combinations of the gamma and 
truncated normal failure distributions. The statistical 
model will be analyzed by computer simulation using a Monte 
Carlo method to generate the gamma and truncated normal test 
times. The parameters of the distributions were selected so 
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that the failure rate curves would be representative of 
those curves used by contractors or that the system relia- 
bility was a preselected value. 
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CHAPTER II 



THE STATISTICAL MODEL 



Section three of reference 1 contains a detailed 
explanation of the statistical model which is being analyzed. 
The following definitions are applicable parts of the model 
used in the computer simulation for the lower confidence 
limit of a series system with four components. For a given 
sample size, , i = 1,2, 3*4 and a predetermined test time, 

T q1 , i = l,2,3,^ a best estimate of the failure rate for 
component i is given by: 



1 = 



2n. 



2N 1 -1- 1 



( 1 ) 



i\i , 



the sum of all test times 



tfhere S* = £ T- * , is 

j=l J 

accumulated on the N components of type i, and f^ is the 

number of failure times which are less than T . . From these 

oi 

best estimates of failure rates, the system reliability 
estimates are given by: 



* 

A _ A. £ 

R s = 6 



( 2 ) 



where X = £ (3) 

s i = 1 1 

The model then uses the following formulae in order to 
compute the lower confidence limit on system reliability: 
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(4a) 



A 2Xg + (K3) 2 + \l 4x s (K0) 2 C+ (K ii)^C 
X u = 2 



k 

if £ f« > 0 
i = 1 



uiMi! U 

u n i = i s i 



k 

if £ fi = 0 
i = 1 



(4b) 



where n is the number of tests. 

Here X u is the upper confidence limit of the failure 
rate for a system with k units in series, and K is a per- 
centage point of the normal distribution. 0 is a correction 

a a k A 

factor for small values of X. and c = £ — / X_. All times 

-L a n Si O 



are in mission units. 

A 

Reference 1 then defines R_ T N to be the lower con- 

s ,L(a) 

fidence limit on system reliability: 



A 



R s ,L(a ) 



= e 



u 



(5) 



It must be noted that since equation (2) is only a best 
estimate for the failure rate, the statistical model ex- 
plained serves only as an approximation for system relia- 
bility. 
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CHAPTER III 



SIMULATION PROCEDURE 



The system to be simulated will consist of four com- 
ponents in a logical series, with a system reliability, R g , 
which may be expressed as: 



4 

- 7T 

i = 1 



wnere R^ = P(T>1) is the true reliability of the i com- 
ponent at mission time one. It is desired to find a lower 

100(1- a )% confidence limit for R , namely the statistic 

s 

R T / -v \ • If ^ . . is in fact the exact 100(1- a )% lower 

s,L(a) s ,L(a ) 

confidence limit for R , then: 

s 

P L R s >§ s,L(a)] = 1 ‘ a (6) 



holds . 

From equation (6), R should be the (1-a) percentile 

s 

point of the simulated distribution of ^(cx)* 




For the investigation a will be chosen as .20 and A n , 

will be defined as the (1-a) percentile point of the distri- 
/\ 

bution of R ,/ ». In order to investigate the distribution 
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of the random variable, a simulation by digital computer is 
used to generate the values needed. Five hundred values of 

A 

R s L( a ) be calculated and ordered such that: 






fi s,L(a) (2)<fi s, L (a) (3 > 



A 

R T / \ 
s,L(a) 



( 500 ) 



Since the value of a chosen for the simulation is .20, the 

A 

value of R t \ will be found such that 20% of the ordered 
s,L(a) ^ 

values are above it. Thus the 80 percentile of the distri- 

A 

bution of R g a j, is found and should equal R g . 

The measure of accuracy will therefore be the value 

R„ - A/, n I . The accuracy of the method will be checked 
s (1 - a ) | 

for different combinations of the failure rate distributions 
among the four components. The sample size, , to be tested 
will consist of 50, 10, and 500 units. The mission times 
for each component, T Q ^ , will be: 



(1) 


.5 mission units 




(2) 


5.0 mission units 




(3) 


T oi such that " — ln^R(T oi ) J = Z(l) 


(?) 



oi 



where Z(l) = (8) 



The third test was selected as an ad hoc rule because of the 
intuitive feeling that this time would give a good measure 

A 

of accuracy to the procedure. The distribution of R s> L( a ) 
will therefore be dependent upon: 
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(1) a 

(2) N i i = 1,2, 3, 4 

(3) T . i = 1,2, 3, 4 

oi 

(4) R 1 i = 1 , 2 , 3 , 4 



The mean and. the standard deviation of the distribution 

A 

of H S) L( a ) will also be calculated in order to better eval- 
uate the accuracy of the model. The procedure for the 
computer simulation of the model is: 

(1) Generate random times, T',. i = l,2,3,4 j = l,2, N 

X J 

for each of the four components in series. 
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T 'l 2 


rpt 

1 13 0 9 * 


T' 

1 IN 


21 


t ' 22 


T 1 

i 23 • 


m, 

1 2 n 


31 


T ’ 3 2 


t - 33 . . . 


T' 

1 3N 


4l 


T \ 2 


m t 

1 43 • 


m, 

1 4n 



(2) Test these times against the selected mission time, 

T ., i = 1 ,2 ,3,4 and if T' . . < T ± , record a failure 
oi’ ij oi 

or if > T q ^ , record a mission success and then 

set 




T 'ij lfr, iJ <T oi) 



! r oi 



if ,» iJ 



o.l. 



(3) Prom the equations (1) - (6) outlined iu daapter II, 

A /\ 

calculate the resulting values of R g and R g . 

(4) Repeat the above steps five hundred times. 
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. . A 

( 5 ) Order the computed values of H T , 

(6) Calculate the mean and standard deviation of the 
resulting distribution and find the 80^ per- 
centile point, A(i_ a ). 

The complete computer simulation is found in Appendix C. 
procedure used is shown above and comment statements have 
been used to aid in following the steps of the program. 



The 
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CHAPTER IV 



RESULTS 

For the procedure stated in Chapter III, the failure 
times generated will be either gamma distributed or trun- 
cated normal distributed. The parameters of the distri- 
butions were chosen so that the reliability of the component 
was a preselected value or the failure rate curves would be 
representative of those curves used by contractors. The 
following cases were simulated: 



CASE 


COMPONENT 


DISTRIBUTION 


PARAMETERS 


% 


I 


1,2 


gamma 


r=l . 5 , s=.036 


.9950 




3,4 


tr. normal 


M= H.28, <T= 4 


.9950 


II 


1,2 


gamma 


r=l. 5, s =.036 


.9950 




3,4 


tr. normal 


m=26, <r=io 


.9984 


III 


1,? 


gamma 


r=1.5, s=.036 


.9950 




3,4 


tr. normal 


m=- 30, <r=45 


.9707 


IV 


1,2, 3, 4 


gamma 


r=l. 5 , s = . 036 


.9950 


V 


1,2, 3, 4 


tr. normal 


m = 8, <r =4o 


.9810 


VI 


1,2, 3, 4 


tr. normal 


aa =20 , (T =40 


.9850 


VII 


1,2, 3, 4 


tr. normal 


^=- 30 , <r =45 


.97 07 



Each case is specified by the type of distribution and 
parameters applied to the four components in series. The 
results in Table I are for the first three cases using all 
possible combinations of sample sizes and test times. The 
results of cases IV, V, VI, and VII are given in Table II. 
These cases are different from the first three in that mis- 
cellaneous test times and sample sizes are used in the simu- 
lation. 
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The first five columns in the tables are self explana- 
tory and the last is the value of TT which is represented by 

4 A 

the formula TT = £ N, X. T ni . It is a measure of the 

i = 1 1 1 

amount of testing required, relative to the component un- 
reliability. 

Appendix A contains discussions of the gamma and 
truncated normal failure distributions. Appendix B contains 
the computation of the ad hoc test times used in Table I. 
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TABLE I 

ACCURACY OF COMPUTER SIMULATION FOR CASES I, II, AND III 

i* 
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TABLE II (Continued) 





o 


O 


O 


o 


o 


O 


O 


o 


O 


°. ] 


Eh 


• 


o 


9 


• 


0 


0 


0 


• 


• 




Eh 


A 


NO 


A 


o 


o 


O 


A 


o 


O 










1 — 1 


CA 


CA 


NO 




ON 


NO 


eg j 

rH J 


>> 






















o 






















05 


A 


04 


00 


eg 


ON 


rH 


CA 


NO 


A 


A 




i — 1 


NO 


'A 


NO 


eg 


NO 


O 


rH 


rH 


i — 1 


2 


O 


O 


O 


o 


o 


O 


O 


o 


O 


O 


O 


o 


O 


O 


o 


o 


o 


O 


o 


o 


O 


o 


• 


• 


• 


o 


0 


© 


0 


o 


• 


• 


05 






















i 

> 






















<D 




00 


O 


eg 


o 


A- 




CA 


CA 


A 




o 


1 — 1 


-3- 


o 


o 


A- 


00 


NO 


00 


A 


• 


A 


eg 


i — 1 


rH 


rH 


O 


o 


o 


O 


o 




O 


o 


o 


O 


o 


O 


o 


o 


O 


O 


•P 
CO CO 
<« 

a 


• 


• 


• 


0 


0 


o 


• 


• 


• 


• 


cv 


NO 


On 


ON 


NO 


o 


oo 


A 


CA 


ON 


cS 


o 


o 


A- 


NO 


-3- 


'A 


o 


rH 


00 


00 


<u 


A 


'A 












-3" 


CA 


A 


k 

1 


ON 


ON 


ON 


ON 


ON 


ON 


ON 


ON 


ON 


ON 


1 1 

! 

> 






















<D 


i — 1 


O 


A 


A 


-3- 


1 — 1 


ON 


NO 


00 


A^ 


T* 


NO 


A 


A 


o 


o 


00 


00 


NO 


00 


A 




CA 


eg 


1 — 1 


rH 


rH 


o 


o 


O 


o 


O 


d 'd 


O 


o 


O 


O 


o 


o 


o 


o 


o 


o 


^-P 
1-3 CO 


• 

1 


















* $ 


CO 


i 




















a 


O- 


A 




ON 


CA 


A 


00 


ON 


rH 


ON 


05 


NO 


CA 


eg 


NO 


-3- 


00 


eg 


A 


H 


A 


<L> 


O 


eg 


CA 


CA 


CA 


CA 


CA 


CA 


CA 


A 


a 


ON 


On 


On 


ON 


On 


ON 


ON 


On 


ON 


ON 



* 



I 



a 


A 


eg 


OO 


eg 


On 


rH 


A 


NO 


A 


A 


i 


H 


NO 


A 


NO 


eg 


NO 


O 


rH 


OO 


OO 


H 


-3- 




^± 






-3" 




-3" 


A 


A 




ON 


ON 


ON 


ON 


ON 


ON 


ON 


ON 


ON 


ON 




• 


9 


























-3- 














O 




















•N 


O 


A 


A 


A 


A 


A 


A 


A 


A 


A 


A 






•» 




#s 




•» 


•» 




•N 


•s 


ON 


eg 


eg 


04 


eg 


eg 


eg 


eg 


eg 


eg 


eg 


o 






•s 




9s 












1 


rH 


iH 


rH 


rH 


1 1 


rH 


rH 


rH 


rH 


rH 


lt 

II 

[ 


II 


II 


II 


II 


II 


II 


II 


II 


II 


II 


CO 


•H 


•H 




•rH 




♦H 


•H 


•H 


m— i 


•H 


« 










O 


O 


O 


O 


o 


O 


1 


O 


O 


O 


O 


• 


• 


• 


• 


• 


• 


} 


• 


O • 


• 


o • 


o 


o o 


A 


O A 


o 


o o 


1 


O H 


O rH 


O A 


O A 


O rH 


O rH 


O rH 


O H 


o eg 


o eg 


M 


^ II 


H II 


^ n 


H II 


^ II 


H II 


^ ii 


H II 


^ n 


H II 


*** 


M «H 


» -H 


H iH 


« 


II -H 


“ *H 


II -H 


« H 


'I -H 


« -H 


W 


•H O 


*H O 


•H O 


•H O 


•H O 


«H O 


•H O 


•H O 


■H O 


■H o 


CO 


S Eh 


SI Eh 


£5 Eh 


£5 Eh 


SI Eh 


SI EH 


3 Eh 


S EH 


3 E-t 


525 IH 



<5 t. 
o 



24 



Toi = 20 



| TT 


-3- 

o 

« 

(N- 


00 

o 

o 

rH 


o 

CM 

© 

<r> 


o 

a5 


o- 


C^\ 


vO 


U 


c*^ 




no> 


P 


o 


o 


o 


o 


o 


o 


o 


o 


0 


• 


e 



I cri 



> 





CD 


ON 


-3- 


o 




d 


o~ 


00 


CM 




° 1 


0^ 


CM 


c— ! 




d 


o 


o 


O 


d 

0 


-P 

1 - W CO 

<pc? 


o 


• 


0 


3 


£ 


CM 


^3- 


ON 




o5 


-3- 


C'N 


<r> 


*f— ! 


0 


ON 


ON 


ON 


-P 


B s 


00 


00 


00 


£ 


, 


© 


o 


« 



o 



M 


> 

0 


i 

i oo 


o- 




M 


d 


H 


o 


CM 


W 


■ > * 


-3- 


0^ 


o 


d d 


o 


o 


o 


PJ 


^-P 


© 


a 


« 


PQ 

<J 

Eh 


(-3 CO 
•* 

^ w 
<oc? d 


ON 


vn 


i — i 




o5 


£>- 




c^k 




0 




NO 


00 




a 


00 


00 


00 






• 


a 


9 





d 




O 


<TN 




8 ON 


rH 


rH 




rH 


00 


ON 


ON 






00 


00 


00 




<d 


0 




o 


o- 


... r 


-3* 


-3* 


-3* 










00 


C^k 


0^ 


c~\ 


CO 


<*k 






• 


CM 


CM 


CM 








•s 


II 


H 


rH 


H 


ca 




II 


1! 


II 


PC? 1 




"H 


*H 


*H 


1 




CM 


CM 


CM 


\ < 


© 


O • 


o * 


M 


O rH 


O rH 


O H 


M 1 

> i 


^ 1! 
« H 


H II 
H *H 


^ II 
“ -H 


CrJ ! 


H O 


'rH O 


•H O 


CO 


3 Eh 


S EH 


S Eh 


<U _ 








o 









25 



CHAPTER V 



SUMMARY AND CONCLUSIONS 

A partial explanation of the procedure developed in 
reference 1. , which is used to compute an upper limit on 
failure rate estimates and lower limits on reliability 
estimates, has been presented in Chapter II. A simulation 
of this procedure, without the assumption of an exponential 
failure rate, was proposed in Chapter III and the results 
tabulated in Tables I and II. 

Examination of the results of the first three cases 
shows that the average accuracy, "D, for the various planned 
test times, PTT, are as follows: 




Many more simulations would have to be conducted, using 
various parameters of the failure rate distributions, in 
order to establish final results. But from the cases 
presented it would seem that the test time selected from the 
ad hoc rule stated in Chapter III, produced the best accuracy 
regardless of sample size. Prom Cases IV and VII the average 
accuracy using the ad hoc rule for test times was .0085. In 
Cases V and VI test times of 1.0, 5.0, 10.0, 15.0, and 20.0 
mission units were used and the accuracy varied from a low of 
.0000 to a high of .0071. 
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APPENDIX A 



A. Gamma Distribution 
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( 9 ) 



( 10 ) 



To evaluate the parameters and meet the requirements that 
R^ = .995 the following procedure was used; 

R(t ) = P[T > t] 

R i = R(l) 

R = P[T>1] 

R = p[2sT>2s] 

R i = P«i r > 28] 

.995 = Ptf! r >2s] 

Therefore for a given value of the parameter r, and the com- 
ponent reliability, a chi-square table look up would give the 
value of the second parameter s. For r = 1.5, s = .035. The 
specific value of r was chosen because the failure rate curve 
is representative of those curves used by contractors. A 
plot of equation (10) with the selected parameters is shown 
in Figures IA through IIIA. 
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B. Truncated Normal Distribution 
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For Case I, was specified at .995 and the following pro- 
cedure was used to evaluate the parameters <2T and M . 
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In Case I, (5~and/^were selected to be 4 and 11.28. From 
equation (12), b = 1.0024. For Cases II and III the values 
of the parameters were chosen such that tne failure rate 
curves would be flatter and again better approximate the 
failure rate curves used by contractors. In Case III the 
restriction of a lower component reliability was also placed 
on the parameters. Parameters for Cases V and VI were 
selected as miscellaneous values in order to give more com- 
plete results to the analysis. Plots of equation (13) with 
the selected parameters are shown in Figure IA through IVA. 
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Gamma and truncated normal failure rate curves 
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Gamma failure rate curve for Case IV. 

FIGURE IA 
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Gamma and truncated normal failure rate curves for 
Case II. 

FIGURE II A. 
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Truncated normal failure rate curve for Case VII. 

FIGURE III A 
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Truncated normal failure rate curves for Cases V 
and VI. 



FIGURE IV A 
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APPENDIX B 



COMPUTATION OF AD HOC TEST TIMES 

The test times for Cases I, II, and III were selected as 
follows : 

1. .5 mission units 

2. mission units 

3. T oi such that - J— ln(R(T .)) = Z(l) (7) 

T oi 0i 

The computation of the planned test times under the ad hoc 
rule for the distributions used is given below. 

A. Gamma Distribution 

R(t) = P(T > t ) 

substituting into equation (?) 

ln(B(T ))=- -i- ln(P(T>T 0l )) 

°i oi 

= - -i— ln(P(2sT > 2sT Qji )) 

T oi ° 

- -L- ln(R(T )) = - -J- ln(p(<| >2sT )) 

x oi oi 

Therefore the following equation must be solved for T_^: 

- -i_ ln(p(lf| r > 2sT )) = Z(l) 
i oi 
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